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Computational Intelligence Controllers 


Controllers that used the following Fields : 

1. Fuzzy Logic (FL) / Fuzzy Control (FC) 

2. Artificial Neural Networks (ANN) 

3. ANFIS 

4 . Evolutionary Computation 


Computational Intelligence Controllers 


4. Evolutionary Computation: 

Heuristic Algorithms Based on the principles of Darwinian 
evolution observed in nature. 

Example of these algorithms: 

■ genetic algorithm (GA) 

■ Differential Evolution Algorithm (DE) 

■ Particle swarm optimization (PSO) 

■ Fish Swarm Algorithm (FSA) 

■ Ant Colony Optimization Algorithm (ACO) 

■ Artificial Bee Colony Algorithm (ABC) 

■ Shuffled frog-leaping algorithm (SFLA) 


ANFIS based on TSK fuzzy inference system 


> The ANFIS is a fuzzy system which is modelled in the form of the 
artificial neural network (ANN) so that a learning algorithm can be 
used to train the system. 

> ANFIS was introduced by Jang in 1993 

> ANFIS stands for Adaptive Neuro Fuzzy Inference System or, 
Adaptive Network-based Fuzzy Inference System. 

> TSK fuzzy inference system is simple in computation and easy to be 
combined with optimizing and self-adapting methods, so that 
ANFIS based on TSK fuzzy inference system is the most type that is 
commonly used. 


Optimizing ANFIS Parameters 

> The main objective of the ANFIS is to determine the optimum values 
of the equivalent fuzzy inference system parameters (of TSK type) by 
applying a learning algorithm using input-output data sets (training 
and test). 

> The parameters optimization are done in such a way during training 
process that the error between the desired and the actual output is 
minimized. 

> The parameters to be optimized in ANFIS are the premise (antecedent 
or IF part) parameters which describe the shape of the MFs, and the 
consequent (conclusion or THEN part) parameters which describe the 
overall output of the system. 


Optimizing ANFIS Parameters 


> The obtained optimum parameters are then used in testing session to 
calculate the prediction. 

> Various methods have been previously proposed to optimize (train) 
ANFIS parameters. These methods can be divided into two types: 

1- derivative-based methods 2- derivative-free methods 

> Derivative-based methods include backpropagation (BP), least 
squares estimate (LSE), and hybrid learning (HL). HL is a 
combination of LSE and BP. 

> Derivative-free methods include other evolutionary computation 
algorithms such as genetic algorithm (GA), particle swarm 
optimization (PSO), differential evolution (DE), shuffled frog leaping 
Algorithm (SFLA), artificial bee colony algorithm (ABC). 



ANFIS based on TSK fuzzy inference system 


EX1: ANFIS model for two inputs , x 2 ) , two MFs for each input are 
used. MFS (A1 , A2) for x 1 and MFS (B1 , B2) for x 2 . Four possible 
rules are used, these rules are: 



Rj : IF Xj is A1 AND is B1 THEN yj = pj a 7 + q 1 x 2 + r 7 

R 2 : IF Xj is A1 AND is B2 THEN p 2 x i Jr c l 2 x 2 Jr r 2 

R 3 : IF Xj is A2 AND is B1 THEN J> = />jA 7 + q 3 x 2 + r 3 


R 4 : IF Xj is A2 AND a_ ? is B2 THEN y 4 = p 4 x, + q 4 x 2 + r 4 


> The table of rules for the TSK-fuzzy model: 



> The following figure represents the ANFIS structure in the form 


of the ANN. 
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The AJNTTS structure ’with two inputs, four rules and one output 


ANFIS based on TSK fuzzy inference system 


The ANFIS structure shown in the previous figure is a multi-layered 
neural network, these layers are: 

Layer 0 

This layer is called input layer as the inputs are applying to the system, 
it does not perform anything else. 

Layer 1 

This layer is called fuzzification layer as the fuzzification process is 
carried out in this layer by applying the inputs to the membership 
functions (MFs) and produce a measure of the degree of belonging of 
each input to a fuzzy MF. This measure is called degree of membership 
(membership grade) which takes values from the range [0,1] and 
usually denoted to it by p. 


ANFIS based on TSK fuzzy inference system 


Layer 2 

This layer is called rule layer as it executes the fuzzy AND of the 
antecedent part of the fuzzy rules. The minimum or product operators 
perform the fuzzy AND. The output of each node represents the fire 
strength (power) of the rule. 

Layer 3 

This layer is called normalization layer. The output of each node is the 
ratio of the firing strength of the i th rule to the sum of all firing strengths 
rules. 



w 1 +w 2 +w 3 +w 4 


, i = 1 , 2 , 3 ,4 


ANFIS based on TSK fuzzy inference system 


Layer 4 

This layer is called defuzzification layer as it executes the consequent part 
of the fuzzy rules. 

the output of each node in this layer is the product of the normalized firing 
strength rule and its corresponding linear function in the consequent part. 


Layer 5 


This layer is called sum layer as it computes the total crisp output of the 
fuzzy system by summing the outputs of layer 4 (this implied the weighted 
average method of defuzzification). 


Defuzzification using Weighted Average Method: 


y 


crisp — 


w 1 y 1 + w 2 y 2 +w 3 y 3 +w 4 y 4 

WX+W2+W3+W4 


Wiyi + w 2 y 2 + w 3 y 3 + w 4 y 4 


Notes 


> The parameters to be optimized (or tuned) in ANFIS are the premise 
(IF part) parameters and the consequent (THEN part) parameters . 

> The training (learning) process is done to get the best values of these 
parameters. 

> No. of premise parameters = No. of control parameters for MF x total No. of MFs 

> No. of consequent parameters = (No. of inputs + 1) x No. of rules 

> The total No. of ANFIS parameters = 

No. of premise parameters + No. of consequent parameters 


EX: 


> Consider the ANFIS model has 3 inputs and each input has 5 
triangular MFs. 

Determine the followings : 

> The total No. of rules 

> the total No. of ANFIS parameters 


Solution 


> The total No. of rules = 5x5x5 = 125 rule 

> The triangular MF has 3 control parameters. 

> No. of premise parameters = No. of control parameters for MF x total No. of MFs 

= 3x3x5 = 45 parameter 

> No. of consequent parameters = (No. of inputs + 1) x No. of rules 

= (3 + l)x 125 = 500 parameter 

> The total No. of ANFIS parameters 

= No. of premise parameters + No. of consequent parameters 
= 45 + 500 = 545 parameter 


ANFIS based on TSK fuzzy inference system 


• EX2: ANFIS model for two input , x 2 ) , three MFs (A1 , A2 , A3) 
are used for input x 1 and two MFS (B1 , B2) are used for x 2 . Six 
possible rules are used, these rules are: 




Rj : IF Xj is A1 AND x 2 is B1 THEN y, = pjXj + q 1 x 2 + 

R 2 : IF Xj is Al AND is B2 THEN y 2 = p 2 x, + q 2 x 2 + r 2 

Rj : IF Xj is A2 AND x 2 is B1 THEN = c L 3 x 2 Jr r 3 

R 4 : IF Xj is A2 AND is B2 THEN y 4 = p 4 x 1 + q 4 x 2 + r 4 
R 5 \ IF Xj is A3 AND x 2 is B1 THEN y 5 = p 5 Xj + q 5 x 2 + r 5 

R 6 : IF Xj is A3 AND x 2 is B2 THEN y 6 = p 6 x t + q 6 x 2 + r 6 




> The table of rules for the TSK-fuzzy model: 


A? 

B1 

B2 

A1 

7i 

72 

A2 

A 

74 

A3 

75 

76 


> The following figure represents the ANFIS structure in the form 


of the ANN. 
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ANFIS based on TSK fuzzy inference system 


EX3: ANFIS model for two input (x { , x 2 ) , three MFs for each input 
are used. MFS (A1 , A2 , A3) for x 1 and MFS (B1 , B2 , B3) for x 2 . 
Nine possible rules are used, these rules are: 


x 2 is B1 
x 2 is B2 
x 2 is B3 

R a : IF Xj is A2 AND x 2 is B1 

x 2 is B2 
x 2 is B3 

R 7 : IF Xj is A3 AND x 2 is B1 


Rj-.WxjisAl AND 
R 2 : IF x,\s AJ AND 
Rj : IF Xj is AJ AND 

u 

R 5 : IF Xj is A2 AND 
R a : IF x, is A2 AND 


R <? : IF x, is A3 AND x 9 is B2 


v 8 . IX AJ 


R 9 : IF x, is A3 AND 


THEN j/ r 
THEN 
THEN y 3 = 
THEN 
THEN 
THEN y 6 ~- 
THEN y>= 
THEN y 8 = 
THEN y 9 ~- 


~-PiXj+ qjx 2 +rj 

Z P2 X 1 + 32 X 2 + r 2 
P3 x i+ q 3 x 2 + r 3 
--p 4 x l+ q 4 X 2 + r 4 

Z PS X I+ 3 S X 2 + r 5 

Z P6 X 1 + V6 X 2+ r 6 
p 7 Xj+ q 7 x 2 + r 7 

--Ps x j+ q$ x 2 + r 8 

z p 9 x j+ q 9 x 2 +r 9 


> The table of rules for the TSK-fuzzy model: 
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> The following figure represents the ANFIS structure in the form 


of the ANN. 
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The ANFIS structni'e with two inputs, nine rules and one output 












MATLAB Code Example 

EX4 : Write a MATLAB code to design an ANFIS model to approximate 
the following function: 


f Oi,x 2 ) = 3 Xj+ 2 x 2 

where Xj and x 2 e [-10 , 10]. 

Show the best values of the optimizing parameters after leaning or 
training is done. 

Consider the following Specs.: 

> Use 100 training data pairs of input and output. 

> Use 3 MFs of triangular type for the inputs x 1 andx 2 . 

> Use the backpropagation algorithm as a learning (or optimization) 
algorithm. 

> The no. of iterations (or epochs) in the training process = 1000. 


MATLAB Code Example 


Note that : 

When we use 3 MFs of triangular type for the inputs x 1 andx 2 : 

> The no. of rules = 3x3 = 9. 

> The no. of ANFIS parameters to be optimized = 27 + 27 = 54. 

• 27 for the antecedent parameters (each triangular MF has 3 tuning 
parameters). 

• 27 for the consequent parameters (each rule has 3 tuning 
parameters). 


The MATLAB Code 


% First, we randomly obtain 100 training data pairs of input and output 
% use the following form of random distribution 
% Xj = Xj L + ( x+ - Xj L ).*rand (No. of required points , 1); 

» xl = -10 + (10+10). *rand(100,l); % xl is a column vector with dimension 100x1 
» x2 = -10 + (10+10). *rand(100,l); % x2 is a column vector with dimension 100x1 
» y = 3.*xl+2.*x2; % y is a column vector with dimension 100x1 

» x = [xl x2 y]; % the training data set 

» n = 100; % no. of samples of the training data set 

» numEpochs = 1000; 

» numMFs = 3; 

» mfType = ' trimf '; % we can use 'gaussmf ' or ' trapmf ' or 'gbellmf ' 

% build ANFIS model with the default initialization of parameters 
% Save initial ANFIS model as fismatl 
» fismatl = genfisl(x, numMFs, mfType); 

% Or we can use: fismatl=genfisl(x,[3 5],char('trimf ','gaussmf ')); 


The MATLAB Code 


% Train the initial ANFIS model over the training data set x 
% Save the trained ANFIS model as fismat2 
» [fismat2,trn_mse,tst_mse] = anfis(x,fismatl,numEpoehs,NaN,x,0); 

% NaN represent the default values of training options like training epoch number, 

% training error goal, initial step size, step size decrease rate and step size increase rate 
% trnmse is avector contains the values of mean square errors during the epochs of training process 
% tst mse is avector contains the values of mean square errors during testing process 
» trnout = evalfis(x(:,l :2),fismat2); % the values of outputs for the trained ANFIS 

» [x(:,3) trn out] % view the desired output and the trained ANFIS output 
» AMSE = mean(trnmse); % the average of mean square errors over the 1000 epochs. 
» epoch = 1 :numEpochs; 

» plot(epoch, trn mse) % curve for mean square error vs. epochs 
» yy = [1 : n ]; % Data Set Index 

» plot(yy,x(:,3),V,yy,trn_out,'o') 


